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Abstract. We consider the product of two independent randomly ro- 
00 ■ tated projectors. The square of its radial part turns out to be distributed 

Cn ' as a Jacobi ensemble. We study its global and local properties in the 

large dimension scaling relevant to free probability theory. We establish 
^> ' asymptotics for one point and two point correlation functions, as well as 

n , ■ properties of largest and smallest eigenvalues. 
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1. Introduction. 

In this paper, we consider the asymptotic distribution of eigenvalues of a 
random matrix of the form nrjinTin where Un and ftn are independent nxn 
^ . random orthogonal projections, of ranks c[n and c[n, whose distributions are 

J^ i invariant under unitary conjugation. This question is part of a more general 

(^ I problem in free probability theory, where one would like to study matrices 

■^ ■ of the form UnArJin where A^^ is a random matrix whose distribution is 

unitarily invariant, and whose empirical eigenvalues distribution converges. 
^ ', Indeed, the contraction of a subalgebra by a free projection has been much 

^ I studied, and the pair [nn, An) is the most natural asymptotic model of a 

random variable A^ free from a projector Tt^. 

Our approach relies on the fact that we can explicitly compute the eigen- 
'k> I value distribution of the above model. Similar computations have been ini- 

^ I tiated in the paper of Olshanski iOr90ll (see also the author's PhD thesis 

IICol0 3a1) but the method presented in this paper is more elementary. 

Actually we will see that the random matrix TXrjtnTin is distributed ac- 
cording to a Jacobi ensemble of parameters (q^, n — q^ — q^, qin ~ c|n)- 
For the definition, see Equation ([T]) and for a good review, IIFor02ll . We use 
asymptotic properties of Jacobi polynomials in order to derive the asymp- 
totic distributions of eigenvalues. We find that the one point function has 
an explicit limit, which we relate to free probability theory. We also check 
that the universality conjectures of Mehta are verified for this model both 
in the bulk of the spectrum and at the soft and hard edges (see IIMeh91L 
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2 BENOIT COLLINS 

conjectures 1.2.1 and 1.2.2 for a statement of this universality problem, and 
recent works of HJohOU ISos99ll for important breakthroughs towards these 
conjectures). 

The universality conjectures at the hard edge in different frameworks 
have been established by Kuijlaars and Vanlessen [KV02| and our result 
extends a part of their work without using Riemann-Hilbert methods. 

As for universality conjectures at the soft edge, a recent work of Ledoux 
IILed02l gives explicit non asymptotic bound for the tail of the distribution 
of the largest eigenvalue of a modified Jacobi ensemble. Our cornerstone 
result is Theorem 12.21 

Theorem. LetX,X' G Mc^^lC] be independent Wishart matrices of param- 
eters {q^,n - q^,] /q^) and iq^,qrx,yci^)- Let] = {X + X')-^^^X[X + 
X')^^^^ (this is well defined by Lemma IZ71 . On the other hand, let Tin G 
M.n(C] be a constant orthogonal projection of rank q^ and fin G Mn(C) 
be a random uniformly distributed orthogonal projection of rank qin- 

Then, under the isomorphism nnM.n{C)nn = Mq^(C), the following 
equality holds in distribution: 

TtnTtnTTn = J 

In particular for qn > qn <^nd q^L + qin ^ fi-, the distribution ofUyjinTin is 
a Jacobi ensemble of parameter (q^L, n — q^L — qn, Qn ~ qn) (on Mq^ (C)j. 

There is a striking analogy between this result and that of fCC021 stating 
results of asymptotic freeness for so-called "Beta Matrices" whose eigen- 
value distribution actually follows Jacobi ensembles. Theorem 12.21 can 
also be found under a different formulation and for different purposes in 
llDouD3< . 

To the knowledge of the author, the link between products of randomly 
rotated projections and Jacobi ensembles had only been observed asymp- 
totically so far, and not at the finite dimension level. 

In accordance to Theorem 12.21 we consider Jacobi ensembles of type 
J(n, Qn, brv] with n ^ oo, and let A^'^'^'^ be the random set of its eigenval- 
ues. This random set is a so-called determinantal point process . We call 
^an.bn (-j^g kernel that drives it (see section U.3.31 ). If a^ ~ an, b^ ~ (Sn, 
n —^ oo, free probabilistic arguments show that the associated mean count- 
ing probability measure converges in moments as n ^ oo. 

Our first series of results are Theorem l4.4l Proposition l4.81 Theorem 14. 51 
which we summarize here: 

Theorem. Assume a^ ~ ocn, hn ~ |3rL as n ^ oo (assumption\I^ 

• The density of the expectation of the eigenvalues counting measure 
for eigenvalues o/ J(n, a^, bn) converges towards the n = cxd limit 
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of the densities defined in Equation (I17I) . This convergence is uni- 
form on any compact set not containing the boundary points r, s of 
the spectrum (see Equation (1161) for the definition ofr, s). 
Let K^'^^'^ be the kernel associated to the Jacobi ensemble as a 
determinantal point process (for definitions, see section \3.3.1\l Then, 
as n ^> oo and uniformly for x G [r + e, s — e], (e > Oj and u, v on 
compact sets, 

1 ,_ h , u V , sinTrfu 



-K^'^''[tc + ——,x+——] = -^ r^ + 0(n 



-1- 



nf{x) ^ nf (x) ' rLf(x) 7r(u — v) 

where f is defined at Equation (1171) . In other words, the universality 
conjecture ofMehta holds in the bulk of the spectrum. 
• For any compact set K such that Kfl [r, s] = 0, there exists a constant 
C > such that for all n, P( A^--^- n K ^ 0) < e"^^ 

The limit distribution defined in Equation dTTJ) admits a connected spec- 
trum [r, s] (plus possibly up to two atoms). In addition, the non atomic part 
admits a continuous density that behaves either like (x — r) ^^^ or (x — r)^^/^ 
close to the spectrum. Following conventions in the physics litterature, the 
first case shall be referred as a "soft edge" and the latter one as a "hard 
edge". We obtain that the relevant spacings for obtaining kernels are the 
usual ones (y\r^/^ for the soft edge, and y\r^ for hard edge). Our main 
theorems are Theorems 14. 161 and 14. 181 

Theorem. • At the soft edge, under Assumption^ let Sr^ be as Equa- 

tion (1151 ) and 



2{-\-sif 
Then for any £ > 0, one has 
1 ,,.„ h„ / u 



;Kn-- (- + ^--+T^) -Ai(u,v) + 0(n-V3. 



hnn2/3 

where Ai is defined at Equation ( BUI) . 
• At the hard edge, under As sumption\3\( without loss of generality we 
assume that r = — 1 j, for any u, v G IR+, 

1 K^n.bn (^_i +^^ ^^^^L ^^ =Fb(u,v)+0(n 



2n2(1+ccn) "" V 2n2(l+an)' 2n2(l + cx- 

where Ft, is defined at Equation (1361) . 

This theorem together with results of PLed021 lead to Proposition 14. 171 
thus answering a question of M. Ledoux about the behavior of the suitably 
rescaled largest eigenvalues. 
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This paper is organized as follows. Part |2l consists in explicit computa- 
tions of densities. Part 13 gathers useful information about free probability 
and Jacobi unitary ensembles, and establishes asymptotics for the eigenval- 
ues counting measures with free probabilistic tools. Part|4|provides asymp- 
totics of suitably rescaled kernels at the hard and soft edges, and inside the 
bulk of the spectrum. 

Acknowledgments. The author is currently a JSPS postdoctoral fellow 
at the university of Kyoto. The results of section R~T] of this paper were 
obtained during his PhD and he acknowledges useful conversations with 
his advisor P. Biane, and also with T. Duquesne and J-F. Quint at an early 
stage of the paper. I also acknowledge stimulating discussions with M. 
Capitaine, M. Casalis, Y. Doumerc and M. Ledoux about Jacobi unitary 
ensembles, and with A. Kuijlaars about universality questions. 

2. Product of two random projections and Jacobi unitary 

ensembles. 

Let Un be the group of n x n complex unitary matrices, and (Xn its nor- 
malized Haar measure. For (a, (3) G M^, consider the probability distribu- 
tion on the Hermitian matrices M.rt(C)sa given by 

(1) (Z^'P)-Met(l -M)'^det(M)Plo<M<idM 

where Z^'^ is some normalization constant. This probability measure is 
called Jacobi unitary ensemble of parameter (n, a, (3) (see for example 

iiFoHni ). 

For n, q positive integers and a > 0, let W[n, q, a) be the probabil- 
ity distribution on Mnxq(C) whose density is proportional to e^"^ Tr(AA*) 
Let W[n, q, a) be the probability distribution on Mn(C)sa of WW* where 
W G MTT^xq(C) has distribution W(rL, q, a). This probability measure is 
called Wishart ensemble distribution and is proportional to det(X) ^^^e^"- '^'^f^^* ' dX 
whenever q > n. We start with a classical lemma whose proof was ex- 
plained to us by M. Casalis. 

Lemma 2.1. Let Xp,Xp/ G M^lIC) be independent random matrices of 
distribution ^[n, p , 1 /n] and W(rL, p ', 1 /n). Then Xp + Xp/ is a Wishart 
matrix of parameter (n, p + p ', 1 /n). Moreover, ifip +ip' >n, then almost 
surely, Xp + Xp/ is invertible and we can define 

J = (Xp + XpO"'/%(Xp + XpO"'/^ 

IfViV' ^ IT-' then the distribution of] admits a density with respect to the 
Lebesgue measure, and it has the distribution of a Jacobi unitary ensemble 
of parameter (n, p — n, p' — n). 
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Proof. Assume p,p' > n. The random vector (Xp, Xp/) has distribution 

Ce-^^''f^+^Met(X)P-^det(Y)P'-^dXdY 

By change of variable formula together with the fact that the change of 
variable (X, Y) -^ (X, X+Y) has Jacobian 1 , (Xp, Xp+Xp/ ) has distribution 

(3g-nTr(Y) ^^^^ y - Xj^'"^ det(X)P-^dXdY 

The change of variable (X, S) -^ (S^^^^XS^^-^^, S) on the cone of positive 
definite matrices is well defined, and has Jacobian detlS)*^. This implies 
that ((Xp + XpO-i/%(Xp + XpO"^/^ Xp + XpO has distribution 

(^g-nTr(Y)^gj^Y)P-^det(l - X)P-^det(X)P'-^dXdY 

This proves that (Xp + XpO"^^^Xp(Xp + Xp/)"^/^ has the distribution of a 
Jacobi unitary ensemble of parameter [^ — n,^' — rC). D 

Theorem 2.2. Let X,X' G Mq^(C) be independent Wishart matrices of 
parameter [c\n,n — q^L, l/cin) (^inJ {c\n, ^n, V^ln)- Define J as in Lemma 
\n\bv 

Let Tin G MrL(C) be a constant orthogonal projection of rank qn and fin G 
Mn(C) be a random uniformly distributed orthogonal projection of rank 
c[n- Then, under the unitary isomorphism Mq^(C) = 7inM.-n.{'C)nn, the 
following equality in distribution holds: 

TtnTtnTTn = J 

In particular for qn > qn <^nd c\n+ c\n < tl, TinTTnTtn h<^s the distribution 
of a Jacobi unitary ensemble of parameter (q^, n— q^ — q^, qn — c\n] (on 

Proof. Let 7t be a (deterministic) projection of rank q^, W and ft be inde- 
pendent random matrices of Mn(C) having respective distributions W{n, n, q^ 
and the invariant distribution on the selfadjoint projectors of rank qn- De- 
fine Xi , Xi as 

(2) Xi = nWftW*n 

(3) Xj = 7rW(Id-7t)W*7r 

By construction, Xi and X2 are independent Wishart matrices in 7rMrL(C]7r. 
Let U be an unitary random variable such that 

nWU* = (Xi +X2)^/^ 

This random variable can be chosen to depend measurably on W. We have 
by definition 

(4) Xi = (Xi +X2)'/^U7tU*(Xi +X2)^/^ 
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therefore, from Lemma EH 7rU7tU*7r has the distribution of a Jacobi uni- 
tary ensemble of parameter (q^, n — q^— q^, q^ — q-n)- Since U is in- 
dependent from ft (indeed, U G cr(W)) and tt is uniformly distributed, the 
distribution of UttU* is the same as that of ft. 

Consequently, nftn has also the distribution of a Jacobi unitary ensemble 
of parameter (qrt, n - q^^ - qn, qn - q^]- 

D 

Remark. The hypothesis q^ < qn and q^ + qn < ti is a necessary and 
sufficient condition for the distribution of TinTCrJ^n to admit a density with 
respect to the Haar measure of TinMnlCJTtn. However, this case enables 
us to study the distribution of the eigenvalues set of any product of the type 
TXnfirJ^n without any assumption on q^^ and q^- Indeed, 

1/ Assume qn + c|n < tl, but q^^ < q^. Since nnftnnn and 7X^71^71^ 
are unitarily conjugate to each other, the study of non-trivial eigenvalues of 
TTnTTnTtn is equivalent to the study of those of TTnTTnTtn, and the latter is a 
Jacobi unitary ensemble. 

2/ Assume that qn + qn > tx and qn > qn- Then consider the conju- 
gate random projector tt^ = 1 — tt^ of rank q^ = n — q^. The non-trivial 
eigenvalues of the ensemble UnTi'^nn are the image by the reflexion of cen- 
ter 1/2 of the non-trivial eigenvalues of Tr^TtnTtn- One has q([ < q^ and 
qn + qn ^ ^ so we come back to case 1/ 

3/ Assume qn + qin > ti and qn < qn- Then with the notations of 2/, 
one has qn > qn and n < qn + qn- Therefore n'^UnTi^ is in case 2/. Thus, 
we have showed how to handle any case. 



3. Global asymptotics for Jacobi unitary ensembles. 

3.1. A reminder of free probability. We define a non-commutative prob- 
ability space as an algebra with unit endowed with a tracial state cj). We 
denote such a space by (A, cf)). An element of this space is called a (non- 
commutative) random variable. 

Let At , ■ ■ ■ , A]^ be subalgebras of A having the same unit as A. They are 
said to he free iff for all at G Aj^ (i G [1 , k]) such that cl)(ai) = 0, one has 

(^[a^ ■■■ai) ==0 

as soon as ji 7^ J2, J2 7^ J3, ■ ■ ■ , ji-i 7^ ji- Collections Si,S2, . . . of random 
variables are said to he free iff the unital subalgebras that they generate are 
free. 

Let (ai , ■ ■ ■ , ak) be a k -tuple of random variables and let C(Xi , ■ ■ ■ , Xi^) 
be the free algebra of non commutative polynomials on C generated by the 
k indeterminates Xi , • ■ ■ , X]^. The joint distribution of the family at is the 
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linear form 

^(,,,..,,,):C(Xi,---,XO^C 

defined in the obvious sense. 

Given a k -tuple (ai , ■ ■ ■ , aic) of free random variables and given each 
distribution \Xa^, the joint distribution |j.(a, , .a^) is uniquely determined by 
the iJ-m's. A family (a^, ■ • ■ , ci]^)n of k -tuples of random variables con- 
verges in distribution towards (ai , ■ ■ • , a^] iff for all P G C(Xi , • ■ ■ , Xj^), 
M-(a'^,-,a'^)(P) converges towards M-(a, ,... ,ak)(P] as n ^^ oo. A sequence 
of families ( a^, ■ • ■ , a]^] a is asymptotically free as d ^ cxd iff it con- 
verges in distribution towards a free random variable. Asymptotic freeness 
of sequence of collections of random variables is defined in an analogous 
obvious sense. 

The following result was contained in IIVoi98l and in fXu97l under slightly 
stronger hypotheses. For a proof in full generality, see [iCol03a< . Proposi- 
tion 2.3.3 p. 52 or [■Col03bJ . Theorem 3.1. 

Theorem 3.1. Let Ui , ■ ■ ■ , Ui^, ■ ■ ■ be a collection of independent Haar dis- 
tributed random matrices o/Mn(C) and ( W?^)igi be a set of constant matri- 
ces o/M.^(C] admitting a joint limit distribution for large n with respect to 
the state n"^ Tr. Then the family ((Ui, U^), • ■ ■ , (Uic, Uy , ■ ■ ■ , (Wt)) ad- 
mits a limit distribution, and is asymptotically free with respect to E (n^^ Tr). 

3.2. Free projectors. Let us fix real numbers < a < b < 1/2, and 

let for all n, n^ be a self adjoint projector of M^lIC) of rank q^ such that 
asymptotically qn ~ an as n — > oo. Let n'^ be a projector of rank q^ such 
that q^ ~ |3rL, and assume that it can be written under the form UttU* such 
that U is unitary Haar distributed independent from n-n 

It is a consequence of Theorem 13.11 that Un and tt^ are asymptotically 
free. Therefore nrji!^nn has an empirical eigenvalues distribution converg- 
ing towards \l■^ M \X2, where \x-\ is the probability 

(1 — a)5o + a6i 



and \X2 is the probability 



Let 



;i-(3)5o+(36i 



r± = a+(3-2cx(3± V4cc|3(1 -a)(1 -(3) 
By a standard S-transform argument (see IIVDN92I . example 3.6.7), 



|j,iK|j,2 = [1-min(cx:, (3)]6o+[max((x+(3-1 , 0]]6i+-^^ — ^ — -^^[r_^r+]dx 

27rx(l — x] 



By Theorem 12. 21 we recover a short proof of the following result: 
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Proposition 3.2 ( IICCOll . Corollary 7.2.). Let X^ and X^ be independent 
complex Wishart matrices with respective distributions Win, p^, Id/n) and 
W(n, p^, Id/n), such that ^n/f^ ~ oc > 1 and Tp'^/n ~ |3 > 1, let 
Ztl = (Xn + X!^]^^ '^^XniXn + X^)^^/^. The expectation of the normal- 
ized eigenvalues counting measure tends in moments towards 

■^a,(3(dx) = g(x)1[A_,A+]dx + max(0,cx— 1)5o + max(0, (3 — l)5i 

where 

v/(x-A_)(A+-x) 



g(^) 



27rx(l — x) 




A+ = 



Indeed, by Theorem 12.21 Zn has the same asymptotic distribution as 
TinTi'^Tiri where Tir^, u'^ E Mp^+p' (C) have respective ranks n and ipn, and 
the proposition follows by a change of variables. Note that in IICC02II it is 
also proved that Zn is asymptotically free with X^ + X^. 



3.3. Jacobi polynomials and Jacobi kernel. In this section we gather 
technical results for the computation of asymptotics. 



3.3.1. Determinantal point process. Denote by A^'^ = {Ai > ... > An} 
the random set of eigenvalues of a Jacobi unitary ensemble of parameter 
(n, a, b). Almost surely, this ensemble has cardinal n. 

It is a so-called determinantal point process, i.e., there exists a kernel 
K^'^ which we will describe at section IT. 3. 31 such that: 

P(A^'^n[xi,xi + dxi] = 1,...,A^'^n[xi,xi + dxi] = 1) = 

dxi...dXndet(K^'^(xi,Xj)) 



We refer to IIDei99l . and to ||Meh9U for a probabilistic interpretation. Fur- 
thermore, P(Ai < x) can be computed explicitely and its value is (see Equa- 
tion (5.42) p. 114of IIDei99ll ) 



(5) 



P(Ai <x) =det(I-K^'^) 






V- 



[x,oo] 



[x,oo] 



k:^'^(xi,xi; 



k;['"(x^xi; 



K--^(xi,Xj 



K 



a.hi 



Xj , Xj J 



dxi . . . dxj 
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3.3.2. The polynomials V^"". For a, b > 0, the Jacobi polynomials (P^'^)n>o 
form a sequence of orthogonal polynomials with respect to the measure 

2a+ b+7r(t+tMb+i ) "* [-1 .i]^'''^^^) ^^ where 

w'^'^(x) = (1 -x)'^(1 +x)^ 
The normalization constant is such that (see IISze75L Equation (4.3.4)) 

Remark. Observe that we choose to consider the weight (1 — x]°'[\ + x)^ 
instead of (1 — xj'^x^ in order to respect the conventional notation for Ja- 
cobi polynomials. The map x ^ 2x — 1 turns the Jacobi unitary ensem- 
ble const det(l — Mj^'detlMj^dM obtained in Theorem ITU into a "clas- 
sical" Jacobi ensemble constdet(1 - M.]°-Aq\.[\ + M)^dM. Therefore 
asymptotics of both ensembles deduce from each other through elementary 
(affine !) functional calculus. 

It will be useful to know that (see Szego IISze75ll ) 



(6) P^'''(x)(1-x)'^(1+x) 



1 



lin 



V 



;i -tj'^+^ll +1)"+^ dt 
2^fx-tl^ t-x 



where F is a closed C^ curve with winding number 1 around x and around 
-1 and 1 . The formula (4.21.7) of IISze75l reads 



1 

2' 



(7) (pa,by(^)= (^+a + b + 1)P^+]>^+i(x) 



and formula (22.6.3) p781 of [AS92| implies that the function 

(8) g^'^(x) = (1 -xjI'^+^'/^tl +x)(^+i'/2p^'^(x) 
satisfies the second order differential equation 

(9) |^9:i''=Xn''gn'' 

where 
(10) 



a^ l-b^ 2n(n+a + b + 1) + (a + l](b + r 



^ ' ' 4(1 _x)2 4(1 +x)2 2(1 -x^) 

will be of fundamental use for our purposes. 
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3.3.3. The kernel K^^. Let p^-^ be the corresponding orthonormal polyno- 
mials. The kernel K°:,'^ can be defined as the function 



n 
'1, 

n-1 



which satisfies for x 7^ y by the Christoffel-Darboux formula (see IISze75L 

formula (4.5.2)): 

(11) 

X y 

Where 

.,2^ a,b_ 2-^'" r(n + 1)r(n+a + b + 1) 

^ ^ ^" 2rL+a + b r(n+ a)r(n + b) 

A Taylor expansion and Equation Q show that 

(13) 

c^x,x) =y:i■^w-■^(x)(p^^(x)(p^'^x))'-p^■^x)(p^^(x))') = 



2 



+ ^Pn-'l(x)Pn-]'''^'(^) 



The function x —^ rL^^Kq'^(x, x) is the expectation of the normalized 
eigenvalues counting measure of a Jacobi unitary ensemble of parameter 
(a,b) on Mq(C) (see for example |Meh91|, A.IO). It is often called the 
one point distribution function. 

4. Local asymptotics and universality. 
We make the following 
Assumption 1. Let (Xn = an/n and |3n = bn/n. 
(14) lim 0Cn = oce [0, +00) , lim |3n = |3 G [0, +00) 

Tl=00 TL=00 

Define 

(15) 

|3n 



, Bn 



2 + an + (3n 2 + (Xn + (3r 

Dn = V(1 + An + Bn) (1 - An - Bn)(l - An + Bn] (1 + An - Bn 

fn = B^ - A^ - Dn, Sn = B^ - A^ + D, 



n 
n 
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In addition, let 
(16) A = limAn, B = limBn, r = limfn, s = lims 

n n n 

Theorems 12.2113.11 and Propo sition 13.21 imply 
Corollary 4.1. The probability measure 

n-^K^-^Mx,x)dx 

tends towards 

^J[x-r)[s-x) ^ 

'[^.^V(1-A-B)(l-x2)'^'' 
in the sense of moments. 

This allows us to define 



fr, X) - 



71(1 -A^-BJ(1 
(17) ^ ^ ^)v 



r, ^ y(X-r)(S-X) 

f(x) - 



7r(1 -A-B)(1 -x2) 

We will see later (Theorem 14 . 41 and Proposition l4.9l ) that the convergence 
of density functions actually holds uniformly on any compact set containing 
neither r nor s. 

Remark. The distribution fn(x)dx already appeared in the study of zeros 
and asymptotics of Jacobi polynomials (see I MSV79 I). Theorem 12.21 pro- 
vides a simple explanation for the apparition of the same distribution in two 
a priori very different places of mathematics. 

It is widely believed that "reasonable" unitary ensembles should have 
universality properties for local spacing both inside the bulk of their asymp- 
totic spectra and at the edge up to some suitable renormalisation. Amongst 
very recent results towards these conjectures, see the recent work of Ledoux 
IILed()2l . 

We settle this universality problem in the specific framework of Jacobi 
unitary ensemble satisfying hypothesis [T] 

Our approach is mainly based on the Christoffel-Darboux formula dTTT) 
and it only holds for non equal parameters in the kernel. In order to set- 
tle this problem we will need the following reformulation of the analytic 
maximum modulus principle: 

Lemma 4.2. Let F^ • C x C ^^ C Z?e a sequence of holomorphic func- 
tions in both variables converging towards some function F uniformly on 
any compact subset ofC^ — {(x,x),x G C}. Then the limit f extends by 
continuity to an holomorphic function on C^, and the convergence holds on 
any compact subsets o/C^. 



12 
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4. 1 . Universality inside the spectrum. We first recall the following result 
of EMI. Assume a, b G M, ex, (3 G M+ and let 



(18) A = [(x(x + 1) + (3(x-1)]^-4(1 +cc+(3)(1 - x^) 

The nature of the asymptotics of p^Ti+ipn^+b depends on the sign of A. 
In the case A < 0, for x G (— 1 , 1 ), let p, 9, y G (— 7t, n] be defined by 



(19) 



cc(x + 1 ) + |3 (x - 1 ) + iV^ 
(1+a+|3)(1-x2) 



2[(1+cx+|3)(1-x^)]-^/Vp 



(20) 

(cx+ |3+2)x-(3cx+ |3+2) - iv^^ 
2(x-l)(cc+(3 + l] 

(21) 

(a+|3+2)x+(3cx+ |3+2)-iv/^ 
2(x + l)(a+(3 + 1) 

The result is 



n 1/2 




(22) 



)arL+a,(3rL+b 



4v/^ 



nn 



1/2 r 



:i -x)(a+(3 + i: 



-|TL(-a-l)/2-a/2-1/4 



2(cc+1 



:i +x)((x+i3 + i: 

2((3 + l) 



n(-|3-l)/2-b/2-l/4 



;i -x2)((X+|3 + i: 



tl/2+1/4 



(cos[((1+a)n+a+ 1/2)9/2 + (-(1 + (3)n + b + 1/2)y/2 

-(2n + l]p/4-7r/4] + (0(l/n))) 



It is a consequence of rGS91[lBG99l (see also IICol()3al . Lemma 4.3.2 
pp. 120-121 ) that this estimate is uniform in compact subsets K of R+ x 
]R+ X R X M X (—1,1] such that for any element in K, the associated A is 
negative. 

Let Yn = Y^ '^'^ where y^'^ was defined at Equation (fT2b . The following 
is a straightforward application from Stirling's asymptotic formula. 



Lemma 4.3. As n —^ oo, 



yn = Tl- 



1 + oc^]^+-^-'/H^ + ^^]^+^^-'/H2 + an + (3, 



;i + o(n-i)) 
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Theorem 4.4. The following holds true: 

where 0(n^^ ) holds uniformly on compact subsets of (r, s). (see the defi- 
nition ofr,sat Equation (1151) ). f was defined at Equation (1171) . 

Proof. Recall that 

By Lemma R31 the right hand side is equivalent to 

7-an-bn f1 _|_ A- -1- a'\rL+an+bn+l/2 

(23) 2 + cc+(3(l+a)-+-n-V2(i+3)n+K-V2 

a^ + b^ + ^ (pa. ,bn (x)pan+1 ,bn+1 (^) _ p^n ,bn (^) pOn +1 ,bn +1 (^^ ^ 

Plugging into Equation (l23t the asymptotics of Formula (|22b yields 



n-K-^^"(x,x) (a.+ P.+ 1)2y^ 



TtVl -x2(2 + CXn+(3n)(1 + ^ J ( 1 + (3 J 

(cos( ^"~^" )[1-2cospn]-sin( ^"~^" )sinp^)(1+0(n-^)] 

where Qn, 9n,yn are defined in Equations (fT9l).(l20b.(l2n) by replacing a, 
by an, and (3 by (3n- Direct computation shows that 

(cos[ — - — J[l — 2cos pj — sm( — - — J sm pj 



2 V 2 ^ '^ 2((x+|3 + l]yT^^ 

therefore we obtain 



and this completes the proof. D 

Using the same method (involving cumbersome calculations with For- 
mula (l22h ') to treat the universality in the bulk of the spectrum in the same 
fashion, one finds: 

Theorem 4.5. For u, v G (0, oo], we have as n ^> oo, 

1 ,,n V, , iJ- V , sinyrfu — v) ^, i, 

— ^^K^-^-(x+— ^^,x +—--) = ^ -l + 0{^y-'] 

rdnW TLTnlxJ ■n-TnlxJ 7r(u — vj 

This limit is uniform for x in any compact subset o/ (r, s) and for u, v in 
compact subsets ofK. 



p 



n,x 
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Here, we present a proof which is more intrinsic and instructive for asymp- 
totics at the edges, making use of the differential equation ®. However, 
with this proof we do not obtain the optimal error term. 

Proof with error term 0(rL^^+'^]. It is a consequence of Equation ^ that 
for any x, the functions 

nfnlxj nfTvixj nfnixj 

and 

p1x:u^(1-x-^)'-+^'/^(1+x+^)(^'^+^)/^P-^Mx+^ 
rLfn(xJ nfn(xj rtfnlxj 

satisfy the differential equation 

(24) p;; + (i+o(n-^))p;,, = o 

where * G {1,2} and the term o(rL^^) has to be understood as n — > cxd 
uniformly on any compact set of couples (x, u) such that the constant A 
determined by x is strictly negative. 

Consider the analytic function u ^ p^ ^(u)p^ ^(v) — p^ ^(u)p^ ^(v] Its 
value in v is zero and its first order derivative c^ is given by Theorem 14.41 
Using Equation (l24l) . one can apply a recursive approximation argument on 
the derivatives of this function in v (see Lemma l4.12l for detail) to see that 
for any e > 0, 

c^\v\,A^)viM-vXA^)v\A^)) = sin(7r(u-v))/7r+0(n-i+^) 

uniformly on compact subsets of C. This result can be checked to hold 
uniformly for v in compact sets of C. Therefore 

^^— ^K^-^Mx + ^^,x + — ^) ~ fn(x)sin(7r(u-v))/7t 

This implies the theorem on compact subsets of C^ such that u 7^ v. The 
general result on arbitrary compact sets of C^ follows by Lemma l4~2l D 



Proposition 4.6 ( IICI91I ). Assume A > 0. Let 

(3(x-l) + cc(1 +x)± Va 
;cc+(3 + 1)(1 -X 



(25) t, = '^^""'/:"i:.r^"^" n + u-^[^ +tij-^- 



where 

,.., , |3(x-l) + a(l+x)± 

(26) t± = 



and 

(27) Ti± = 



-2((x+|3 + 1)(x-l 
(x-1)£,± 



x+1 
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Let to = t+ if \tJ^ > |t+| and to — t_ if \tJ^ < |t+|. Then there exists a non 
zero real number Co such that 

(28) IPr-^'^lx)! < -^to^ 



n 



Furthermore, it is a consequence of [BG99il that this estimate is uniform 
on compact subsets of {x, A > 0}. 

Lemma 4.7. Let A> 



min([l+U^ [1+^+]'] < n ^!rVI^n ^ max([l+U^ [^+U' 

(I -x](a+ |3 + 1] 



with equality iff A — 
(29) 



^2,,, ,2,/ 2((3 + i: 



< max[ 



min([l+Ti+]^ [1+Ti_]^] < ,, ^o^n < max([l+Ti+]^ [1+tiJ^ 

(1 +xj(a+ (3+1) 

wiY/z equality iff A = 

(x(x + 1) + (3(x-1) + Va \ / (x(x + 1) + (3(x-1)-Va ' 
"'''"' (1+a+(3)(1-x2) j '1^ (l+a+|3)(1-x2) 

<4[(1+a+|3)(1-x^)]-^ 

'( x(x+1) + (3(x-1) + VA y / (x(x + 1) + (3(x-1)-Va ' ^ 
(1+a+(3)(1-x2) J 'l^ (i+cc+(3)(1-x2) 

wzY/z equality iff A — 

Proof (sketch). This is a consequence of IICI91II . For the first point, it is 
a consequence of Equations (l20b and (l26l) and the complex triangular in- 
equality. For the second (resp. third) inequality, make use of Equation d^TT) 
and (Ell) (resp. (dl). D 

Proposition 4.8. Let an and bn Z?e sequences satisfying Assumption\J\ and 

£ G (0,1 -S). 

There exists a constant C^ G (0,1) depending on e, a, (3 j'mc/j that for n 
/ar^e enough, for all x G [s + £, 1], K^'^'^'^ (x, x) < C^. 

As a consequence, almost surely, there is no eigenvalue in [s + £, 1] /or 
n large enough in the sequence of Jacobi unitary ensembles of parameter 

(n, an,bn). 
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Proof. For the first point, Proposition 14.61 together with Lemma 14.71 and 
Equation ( E^ show that according to the definition of the one point corre- 
lation function of Equation (IT3t . one has |K^'^'^'^(x, x]| < P(rL)CQ where 
P is some polynomial. Therefore any Ci G (Co, 1 ] satisfies the announced 
property. 

For the second point, observe that the summand of Equation ® satisfies 



K{;-^(xi,Xi) ■■■ K;[-^(xi,Xj 



K-'^(x^,Xi) ■■■ K--b(x^,Xj: 



< n^C7' 



therefore 



P(Ai <s + £) >2-exp(n^C7 ) 

for n large enough. The result follows by the Borel-Cantelli Lemma to- 
gether with the fact that the series (P(Ai > s + £))tl has finite sum. D 

Remark. Proposition l4.8l show that the result of Theorem l4.4l extends on any 
compact set remaining at positive distance from both fn and Sn (defined at 
Equation (IT51). In the case both f ^l and s^ stay at a positive distance froom 
1,-1, A. Kuijlaars asked whether the uniformity holds on any compact 
subset of (—1,1). We have not been able to answer this question if the 
compact set K contains the transition points r, s. It seems that Riemann- 
Hilbert techniques (see IIKV02II for a bibliography) could give more insight. 



Proposition 14. 81 has an interesting consequence in terms of geometry of 
Hilbert spaces: 

Proposition 4.9. Let On.q be the set of subspaces of C"^ of dimension q 
together with its uniform probability measure Pq. Assume that there exists 
ri > such that for all n, an + (3n < 1 — "H- 

It is possible to find an angle 9 G [0,7r/2) satisfying, for any e > 0, 
the existence of a constant c > such that for a// n, q, q' satisfying q < 
an, q' < (3n, there exists a subset F o/Hn.q x ^n,q' of measure larger 
than 1 — e^'^^ such that 

V(Vi,V2) gF,Vxi g Vi-{0},X2G V2-{0}, angle (xi,X2) G [Q - i,n/l] 

The value ofQ is given by 

cos^ Q = s 

where s was defined in Equation (IT6b (observe that the assumption on r\ 
ensures the existence ofd G [0, n/l]). 



Proof. This is a consequence of Proposition 14. 81 together with the fact that 

llTrTi'lP = ||7r7r'7r||. D 
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4.2. At the soft edge. Instead of assumption [H we shall work under the 
following slightly different assumption. 

Assumption 2. Let ocn = an/n, (3n = bn/iT- Then 
lim inf cXn > , lim sup an < oo 

^ n 

and 

liminf |3rL > 0, lim sup (3n < cxd 

^ n 

The clause lim inf^ a^ > ensures that the behavior of the kernel in the 
neighborhood of s^ will be of "soft edge" type. In assumption [l] it was 
rather natural to assume the liminf and lim sup's are actual limits. It was 
not necessary but allowed lighter notations (in particular cXn and |3n could 
be replaced by their limits in the formulas for asymptotics). At the edge 
of the spectrum, assuming that the liminf and lim sup's are actual limits 
do not simplify the notation (for example replacing s^ by its possible limit) 
because unlike for the asymptotics inside the bulk of the spectrum, a control 
on the speed of convergence is also needed. 

4.2.1. Preliminary estimate. 

Proposition 4.10 (Chen-Ismail, IICI91I ). The following holds true 

2(cXn+1) \*^/V 2((3n+l) ^^"^' 



;i -Sn)(an+(3n+l)/ V ( 1 + Sn] ((Xn + |3n + 1 

(l_S^)-an/2-V6(-|+§ 



-Qn/2-1/6ri I -x i-bn/2-V6 I ^^ + Oin} ^"^[^ + Pnj"' '^ \ 



(1 +an+(3n)^+'''^+^'^ 

Remark. • This result is contained in lICKlil with different notations. 

The proof of IICI91I holds only for arithmetic sequences an, bn, 
but uniformity can be easily derived from the paper using Bessel in- 
equality (see [Col03a|, Lemma 4.3.2 pp. 120-121 ). Alternatively, it 
is possible to choose the approach of IIBG99II making use of Integral 
®. 
• In this section we only handle the case of Sn but the obvious coun- 
terparts of Assumption|2lat the edge fn also holds true. 

The Airy Equation f " = xf, has a conventional basis for its solutions, 
denoted by ( Ai, Bi), where 



7rAi(x) = lim 



cos(tV3 + xt)dt 
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and 



7rBi(x) = lim 

It— >+oo 



[exp(-t^/3 + xt) + sin(t^/3 + xt)]dt 





On [0, oo), Ai is positive and tends towards zero as x ^ oo, whereas Bi is 
positive and increases towards infinity. Besides, Ai(0) = 9^^/^r(2/3)^^ 
The Airy Kernel is defined as 

,,., ,., , Ai(u)A i^(v)-Ai(v)AV(u) 
(30) At(u,v] = 



u — V 



4.2.2. Computation of the kernel. Let Sn be the largest zero of Xn'^'^" ^^ 
(—1,1) (where Xn"'^" ^^^ defined in Equation (ITOb ) and K-a be the real 
number such that — h,^ is the derivative of Xn^ '^" at Sn- The sequences s^ 
and hri actually depend on n, an, ^n.- One checks that as n ^^ cxd, 
(31) 

1/3 



2(1 -s^] 



Let 

*n(x)=g^-^MSn + xK^) 

where g^"'^" was defined at Equation (EJ), and 

*n(x) = g^-l^MSn + xh^l) 

For any real number R, the function (|)n is defined on the interval [R, rL^/^( 1 — 
Sn]] for n large enough. Furthermore, its value is zero in h,n(l — Sn). Let 

(32) Xn(x)=x"'^'''MSn + xh^^)h^2 

The function Xn is positive on the interval [0,Hn^(1 — s^]] and tends uni- 
formly on compact sets towards the identity function. By construction, its 
value in zero is zero. The function cjjn satisfies the differential equation 

(33) Cl)n" = Xn'^rx 

Lemma 4.11. The functions (|)ru ^n cire decreasing and positive on [0, h,n( 1 - 

Sn)]. 

Proof We prove only the result for cj^^l, the proof for ^n being exactly the 
same. The fact that 4^n(0) is positive is a consequence of Proposition l4. lOl 
Let us first show that for n large enough, 4)^ is decreasing for x > 0. As- 
sume that 4)n has a zero inside ( , HrL( 1 — Sn) ) • This implies that there exists 
X such that 4)n(x) < 0. Therefore there exists x such that both 4)n(x) < 
and fn(x)' < 0. Since cj^n satisfies the differential equation (l33t and since 
Xn is strictly positive on the interval [0, h,n( 1 — s-n]], this contradicts the fact 
that 4)^^^(h,T^( 1 — s^) ) —0. Therefore ^^ has no zero inside (0, ]\n[ 1 — s^) ) • 
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This implies that for n large enough, (^n is positive on (0, hn[^ — Sn)). If 
one assumes that it is strictly increasing at some place, this would again 
contradict the fact that (|)TT^(h,T^(1 — s^)) =Oby RoUe's theorem. Therefore 
we have proved that for n large enough, c})^ is decreasing for x > 0. D 

Lemma 4.12. 1/800 < -^^ < 2 

Proof. By Lemma R-. Ill the function cj)^ is negative on (0,hri(l — s^)) 
and increasing, therefore I4>(^(1 ]| < 4>n(0) (or else integrating cf)^ over the 
interval [0, 1] would contradict (jj^i ranging in [0, 4)^1(0)]). Integrating (^^ 
over [0,1] and using the differential equation therefore shows that |(t)^(0) | < 

24)n(0). 

For the other inequality, observe first that 4)n(1/10) > (^niO)/!. In- 
deed, if this were not the case, by positivity assumption, there would be 
t e [0,l/10],-c|);(t] > 5cl)^(0) and some t' e [1/10,6/10], -^(t') < 
4)n, which would result in the existence of some t" G [0, 6/1 0] , 4^n(t") > 
44)tt^(0) . This contradicts the differential equation because (^^ is decreasing. 

On the interval [1/20, 1/10], cj?;; > ct)n(1/10)/20 thus by the preced- 
ing inequality, cj)^ > 4'tl(0)/40. Integrating, this yields —<^!^[^/20) > 
-KiV^O] + ct)n(0)/800 > <^A0)/800. D 

Lemma 4.13. For any e > 0, one has <^n[x]/<^n[0) — Ai(x)/Ai(0] = 
0(rL^^/^+'^) uniformly on compact subsets ofC. 

Proof. In this proof, denote the power series expansion of (j^n and Ai by 

^^[x] = ^ 4)n[k]x'^, Ai(x) = ^ Ai[k]x^ 

k k 

An application of Cauchy integral formula to Equation © on a circular 
contour of center Sn and diameter d(Sn, {—1 , 1})/2, and the integral triangle 
inequality shows that that there exists a constant Ci > such that 

Therefore, for any rj > 0,r\' E (0,2/3), there exists a constant C2 > 

xe [-n^',n^'] 

(34) Y_ *n[k]x'^ < C2n-'2/^-^''^V^/3 

k>nn 

Denote the power series expansion of Xn(^) by XnM = X^k>o ^^'^^^ where, 
by assumption bo = 0, bi = 1 . There exists a constant C3 such that for all 
k>2. 
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According to the differential equation structure of Equation (l33b . the fol- 
lowing recursive equation is satisfied: 

n-2 

n{n -^]an = Y_ ^'iCLix-i-i 
1=1 

Thanks to this equation and with Lemma 14.121 one can show that there 
exist constants r) > and C4 > such that for n large enough, and for any 
k<rL^, 

|ct)n[3k]/(t)^^[0] - Ai[3k]/Ai(0)| < C4n"^/^Ai[3k] 

(35) |4)n[3k+ l]/(l)n[l] - Ai[3k+ 1]/Ai(0)| < C4n-^/3Ai[3k+ 1] 

I4)n[3k + 2]| < C4n"^/^Ai[3k] 

Fix r|' G (0, 2/3). Equations (l35b show that there exists a constant C5 > 
such that 

^ cl)n[3k]n^^74)n[0] = }^ Ai[3k]rL^^7Ai(0)(1 +0[tx-^^^)] 

k=0 k=0 

Til tlI 

^4)^[3k+ l]n^^7*u[0] - _^ Ai[3k+ l]ni^^7Ai(0)(1 +0(n-2/3^) 

lc=0 k=0 

^ 4)^[3k + 2]n'^^74)n[0] < Csn-^/^ _^ Ai[3k]n'^^7Ai(0] 

k=0 k=0 

Besides, ^j^l^ Ai[3k]ni^^7Ai(0) and IIkloAi[3k+ l]ni^^7Ai(0) grow 
quicker than any polynomial as n — > cxd because all summands have the 
same sign. This together with the remainder estimate (0?!) and the fact, by 
Lemma R-.lll that one has 4)n(Tt^ ) G [0, 4)n(0)], imply that for any £ > 0, 

I4)n[l]/4)n(0) - Ai'(0)/Ai(0)| = 0(n-2/3+.^ 
An application of Inequalities (l34T) and (l35t concludes the proof. D 

Lemma 4.14. Let Cn = 2(2rL + an + bn + 2)/h^. T/zen 

^n(x)/$n(0) - Ai(x - Cn)/Ai(-Cn] = 0(71-^/3+^) 

uniformly on compact subsets ofC 

Proof. Observe that x — > ^nl^) satisfies the differential equation 



n-n fLn iLh 



where s^ is the largest zero of x^-l''^ ^^ (~1 > 1 )■ Besides, the function 

x^Xn-i''Ms; + x/HH]/H^ 
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has the same properties as Xn, namely it tends uniformly on any compact 
set towards identity function and is positive on ]R_|_. 

An application of Taylor approximation formula shows that 

therefore we are exactly in the hypotheses of Lemma 14.131 and the proof 
follows in the same way. D 

Lemma 4.15. Uniformly on compact subsets ofC, for any t > 0, we have 

Proof. First observe that ^n[x] = (^ni'X- — C-n) + 0{n^^^^) by the previous 
Lemma. Then it is standard that 

by standard power series analysis. D 

Therefore we end up with 

By Formula (fTTT) we have, for x 7^ y . 



which by Lemma R-.lSl is 

I s^ 

Since the function is analytic, Lemma 1431 implies that this holds also for 
x = -y. ^^ ^^ 

As a consequence of Lemma 14. 131 the asymptotic of Lemma B-.lOl is not 
modified by replacing s^ by s^ because Sn — Sn = 0(n^^). Therefore, 
again by Lemmas |4 . 1 3 1 and |4 . 1 01 the above left hand side tends towards the 
Airy kernel. 

Theorem 4.16. For any e > 0, 

-iK^-^Msn + Tf - s + ^) = Ai(x,ij) + 0(n-^/3+^] 

rLn fin iLn 

where s^ and h^ are defined above Equation (1311) . and the latter gives an 
estimate for h^. This asymptotic holds uniformly on any compact subset of 

R. 

From this, it is possible to establish a central limit type theorem for the 
largest eigenvalues 
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Proposition 4.17. In the ultraspherical case Qn = b 



rb 



( (Al - Sn)Hn, (A2 - Sn)Hn, . . . , (A^ - Sn)Hn, 0,0,...] 

converges in distribution towards the Airy ensemble asn —^ oo, in the sense 
that any finite dimensional marginal converges in distribution. 

Proof. We prove the convergence in distribution of ( Ai — SnJH^L, the general 
statement being obtained by the same standard methods. Observe that for 
V > u, 

viA^-'"- n [sn + T^, sn + ^] ^ 0) < p(a:^-"'^ n [s, + -Ji,oo) ^ 0) 

According to Proposition 6.4 of IILed02L in the ultraspherical case an = 
bn = an, there exists a constant C such that for every < £ < 1 and 
n> 1, 

P(A7>Sn(1 +£)) < Ce-^^'''/^ 

This constant exists again in our more general framework (the constant C 
of IILed02l can be chosen to depend explicitly and continuously on a). 

By Theorem 14.161 and dominated convegence, the right hand side of 
Equation dSj) on the set [s^ + -j^, Sn + f^] converges as n — > oo. Addi- 
tionally, when V — > oo, V[A.^'^'^ H [Sn + f^, oo) ^ 0) tends towards zero 
by the result of [ Led02 1 . " D 

Remark. • A direct analysis from the asymptotics or the modified Ja- 

cobi Kernel for the above result escaped us because our results only 
hold only uniformly on compact sets. A direct approach would be 
very interesting but for the moment the result of IILed02ll remains 
unavoidable. 
• It would be interesting to check the result of IILed02ll in the most 
general (an 7^ bn) case. This would result in the convergence after 
rescaling towards an Airy ensemble in full generality. 

4.3 . Kernel at the hard edge. According to papers of Kuijlaars et al IIKV02I 
in which Riemann-Hilbert techniques are used, we expect the relevant ker- 
nels at the hard edge to involve Bessel functions. We present a short and 
self contained algebraic solution to this question. We make the following 

Assumption 3. The sequence bn is constant (we denote its value by the 
nonnegative integer b), and defining o-n = O-n/Ti, we assume 

< liminfar, < 00 
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The Bessel kernel is defined by 



(36) Fb(u,v) 



2fu-vl 



where Jb is the usual Bessel function of the first kind and of order b, satis- 
fying 

(37) Uz) = [z/D^y \' [zHf^ 

^ n -V- h In I 



Theorem 4.18. For any u, v G 



^^^(n + b)!n! 



^+, 



^ K^-'(-l+^r^7i^^^ T.-l+^r^TT^^ -) =Fb(u,v]+0(n-^; 



2n2(1 + ccn) "" 2n2(l + cx^] ' 2n2(l + ol^, 

and this estimate is uniform for any compact set in M+. 

Proof. Observe that 

J(,(z]=-Jb+Uz]+bJb(z)/z 
therefore 



Fb(u,v] = 



2(u-v) 
For future use, note that the coefficient in -u,^/^+^^/^+'^ of 

-Jb( Vu) VvJb+i ( Vv] + Jb( VvjVuJb+i ( Vu] 

is 

(k-l) 



(38) 



(b + k)!k!(b + l)!l! 
According to HAskVSI . p. 7 Formula (2.2) 

pabr -I , ^1 _ (b + lln ^ (-n)i,(n+a + b + 1)ic /^xi^ 
^ ^ ^n^^ n! ^ k!(b + 1)k U^y 

k=0 ^ ^ 

where (a)k = a(a + 1 ) . . . (a + k — 1 ). 

In order to establish asymptotic properties of this polynomial, let us write 
it in the equivalent form 

pa.W_i , ^1 = (b + T^)' ^ (-n)^(n+ a + b + 1)i, ty^\^ 
"" ^ n^^ n! ^ k!(b + k)! U^. 

k=0 ^ -^ 



Isolate one generic summand of P^^^'^ri ( — 1 -|- ^^^ 



k 



(bn + n) ! (-n)ic(n + g^ + b^ + 1 )k / u 

n! k!(bn + k]! 1 4n2(l + cx^ 
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The coefficient in u\^ of 



pan,b,w_i ^ ^ ^.pa bw_-, ^ V 



7x22(1 +ccn) ""'' 2n2(1 +an) 

.pan,bn(_-, ^ ^ ^)pan bn(_-| ^ ^ 



7X22(1 +an) "^"^ 27X2(1 + OCr 



IS 



(b + n)!(b + 7x-1)! 

7x!(7x-1)!k!(b + k)!l!(b + 1)1(47x2(1 +ccn))'"+^ 

{(-7x)t,(7X + an + b + 1 )fc(-7X + 1 )t(7X + an + b); - 
(-7x)i(7X + an + b + 1 )t(-7X + 1 )k(7X + an + bjj 

(b + Tx)!(b + 7x-l)! 
" 7x!(7x-1)!k!(b + k)!l!(b + 1)1(47x2(1 +ccn))'"+^ 

(-7X + 1 )t_i (tX + an + b + 1 )t_i (-1^ + 1 )k-l (tX + an + b + 1 )k-l 

{-Tx(rL + an + b + k) (-TX + I) (tx + an + b) - 
(-n)(rL+an + b + l)(-n + k)(n+an + b)} 

This simplifies to 

(b + 7x)!(b + Tx-1)! 



Tx!(Tx-1)!k!(b + k)!l!(b + 1)1(47x2(1 + cxn))'^+^ 

(-7X + 1 )t_i (tx + an + b + 1 )l_l (-TX + 1 ),c-l (tX + an + b + 1 )k-l 

(-Tx) (tx + an + b) (I - k) (2tx + an + b) 

_ (b+Tx)!(b + TX-1)! 

"Tx!(Tx-1)!k!(b + k)!l!(b + 1)1(47x2(1 + cxn))^+^ 
(-Tx)t(7x + an + b)v(-Tx + 1 )k-i (tx + an + b + 1 )k-i (I - k) (2tx + an + b) 

As TX ^^ oo, the above expression can be simplified: 
^^^^i=|L_n--(, +a„)-'(-1)"-'(2 + aJ(, +0(n-')) 

One can show that the remainder function 0(tx^^ ) is smaller than Tx^^p (k, I) 
where p(k, I) is a suitably chosen polynomial in k and I). Additionally, 

Yn = n2(l + an)^+^ (2 + ccn)"^ + 0(n) and 

w--^(-1 + . ,,^^ J = 2--( ^ )^1 + 0(7x-M) 

27x2(1 + OCn) 27X2(1 + an) 
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Together with Equation (l38t . we deduce that 

""" -K---V1 + . . " . ,-1 + 



nlfrL + an + bl! 2-^^--^ 



(n + an - 1 )!(n + b - 1 )! In + a. 



^a./2,b/2r 1 ^ ^1^ ^ an/2,b/2(_-| ^ •"- 



27X2(1+ an) 27X2(1 +CCr 

^ ^pan,b^ - V 

TV V • ' -^„2f■l , ^, iJ'^n-1 



I I + OtnJ 
V h, , U 



27X2(1 +(Xn) '^"' 27X2(1 + CCr 



27X2(1 +(Xn) 27X2(1 +CCn) 

= (u-v]Fb(u,v)(l+0(7x-i)) 

Therefore, for any compact subset of C x C not intersecting the diag- 
onal {(x,x),x G C}, one has the announced result. By Lemma l4~2l this 
convergence is uniform on any compact subset of C x C. D 

From this, we can also state a result about the behavior of the smallest 
non-zero eigenvalue: 

Proposition 4.19. Under Assumption \3\ the random sequence of vectors 

((Ai + 1)7X2(1 +an),(A2+ 1)7X2(1 + (xj , • • . , (An + 1 )n2(l + (xj , • . •) COH- 

verges in distribution. 

Proof. This is a consequence of Equation ^ and dominated convergence 
theorem. D 

5. Concluding remarks. 

5.1. Limiting procedures and modified Laguerre ensemble. In IICol03al . 
the following result is proved 

Theorem 5.1. For 7X > q, 7X > q', let Tin.q.q' be the canonical projection 
of Mn(C) onto its upper left comer Mq q/ (C) with q lines and q ' columns. 
Let dA be the standard Lebesgue measure on Mq_q/(C) Fom > 2q > 2q', 

<,q,q'(^^n) =Cq,q.,ndet(l -AA*)--^-'''l||A||<ldA 

where Cq,q'_n is a normalization constant. 

This result is also a consequence of the present paper and it implies 

Theorem 5.2. Let "v^ be the probability measure Cn,qe^''^'''^'^*dM on 
Mq(C), and qn be a sequence of integers tending towards infinity such 
that there exists a C > such that c\n— Ctx- Then 

l\/n/qn<,q,(M-n)-^qnl =o(1) 
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where \ ■ \ denotes the total variation measure. 

This result was already known to IIDEL92 1 under the assumption that 
q^ = o (n) . Jiang informed the author that he recently obtained by different 
methods ([Jia03 1) an improvement of this theorem to the case c[n = o(n^). 

The Laguerre Polynomial (LJ^)n>o is a family of orthogonal polynomials 
with respect to the measure x'^e^"! [o,oo) such that the leading coefficient 
is [—^]^/nl. These polynomials determine the determinantal point pro- 
cess structure of a Wishart ensemble of parameter {n,n + a,n^^). As 
TL ^ cxD, an/n ~ (X > 0, the average eigenvalues counting measure of 
W{n, an, n^ ) converges towards the so-called Marcenko-Pastur distribu- 
tion 

V^(u-x)(x-v) 
const. -^^ 1 [u,v]dx 

A. 

where u = 2 + a. — 2y/T+~a, v = 2 + a + 2V1 + oc 

With Speicher's non-crossing cumulants theory (see INSOOII ). one can 
prove that this distribution is both a free chi-square distribution and a free 
Poisson distribution. 

Upon knowing that the average eigenvalue counting measure of the GUE 
converges towards the semi-circle distribution, it is easy to understand via 
matrix models why the Marcenko-Pastur distribution is a free chi-square 
distribution. 

However, as far as the author knows, there was no matrix-model explana- 
tion for the coincidence between free Poisson distribution and Marcenko- 
Pastur distribution. This paper provides an explanation: indeed. Theorem 
15.21 this implies that contraction of a random projection by small projec- 
tions is almost a Wishart matrix; in addition, contraction of a matrix A by a 
random projection of rank da is a matrix model for oT^ fold free additive 
convolution of A. 

Note that at the level of orthogonal polynomials, this is in accordance 
with the following well known approximation result in orthogonal polyno- 
mial theory (see IAsk75l . Formula (6.1 1)): 

limP;i'M-^)=L» 

D— >oo D 

This gives a free probabilistic motivation for computing the local spac- 
ing results for the Laguerre ensemble. The methods of this paper can me 
followed line by line to obtain similar results for the modified Laguerre en- 
semble. For the asymptotic kernel at the edge we have to make use of the 
differential equation g" = X9 with g = e^''/^x''^+^'/^L^(x) and 

, , 2rL + a + 1 1 - a^ 1 

X(^) = — ^ + 



2x 4x2 
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and at the hard edge, one can use the following hypergeometric representa- 
tion 

a 



Ufxl 



Mf-n, a+ l.xl 



where M is the confluent hypergeometric function. 

5.2. Remaining questions. It would be very interesting to investigate pos- 
sible extension of the dictionary between free probability and classical (pos- 
sibly modified) polynomials (Charlier, Meixner, etc.), and investigate uni- 
versality properties. 

The study of the semi group of free additive convolution, in particular 
the study of random matrix models obtained by contractions of unitarily 
invariant matrices, and obtaining nice Theorem 12. 21 - like explicit densities 
which can be handled for local asymptotics purposes remains a challenging 
problem in full generality, for which other ideas are needed. 
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